Information Entropy and Mutual Information-based Uncertainty Measures in Rough Set Theory
نویسندگان
چکیده
As an extension of the classical set theory, rough set theory plays a crucial role in uncertainty measurement. In this paper, concepts of information entropy and mutual information-based uncertainty measures are presented in both complete and incomplete information/decision systems. Then, some important properties of these measures are investigated, relationships among them are established, and comparison analyses with several representative uncertainty measures are illustrated as well. Theoretical analysis indicates that these proposed uncertainty measures can be used to evaluate the uncertainty ability of different knowledge in complete/incomplete decision systems, and then these results can be helpful for understanding the essence of knowledge content and uncertainty measures in incomplete information/decision systems. Thus, these results have a wide variety of applications in rule evaluation and knowledge discovery in rough set theory.
منابع مشابه
A new method for measuring uncertainty and fuzziness in rough set theory
Based on the complement behavior of information gain, a new definition of information entropy is proposed along with its justification in rough set theory. Some properties of this definition imply those of Shannon’s entropy. Based on the new information entropy, conditional entropy and mutual information are then introduced and applied to knowledge bases. The new information entropy is proved t...
متن کاملEntropies Of Fuzzy Indiscernibility Relation And Its Operations
Yager’s entropy was proposed to compute the information of fuzzy indiscernibility relation. In this paper we present a novel interpretation of Yager’s entropy in discernibility power of a relation point of view. Then some basic definitions in Shannon’s information theory are generalized based on Yager’s entropy. We introduce joint entropy, conditional entropy, mutual information and relative en...
متن کاملUncertainty Measures for Multigranulation Approximation Space
Multigranulation rough set theory is a relatively new mathematical tool for solving complex problems in the multigranulation or distributed circumstances which are characterized by vagueness and uncertainty. In this paper, we first introduce the multigranulation approximation space. According to the idea of fusing uncertain, imprecise information, we then present three uncertainty measures: fus...
متن کاملCombination Entropy and Combination Granulation in Rough Set Theory
Based on the intuitionistic knowledge content nature of information gain, the concepts of combination entropy and combination granulation are introduced in rough set theory. The conditional combination entropy and the mutual information are defined and their several useful properties are derived. Furthermore, the relationship between the combination entropy and the combination granulation is es...
متن کاملA research on classification performance of fuzzy classifiers based on fuzzy set theory
Due to the complexities of objects and the vagueness of the human mind, it has attracted considerable attention from researchers studying fuzzy classification algorithms. In this paper, we propose a concept of fuzzy relative entropy to measure the divergence between two fuzzy sets. Applying fuzzy relative entropy, we prove the conclusion that patterns with high fuzziness are close to the classi...
متن کامل